Papers with straight-through estimator
Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning (2020.emnlp-main)
Copied to clipboard
| Challenge: | Latent structure models can mitigate the error propagation and annotation bottleneck in pipeline systems, while uncovering linguistic insights about the data. |
| Approach: | They propose a latent structure model with a pullback of the downstream learning objective. |
| Outcome: | The proposed model outperforms the known and proposed model in the same family and yields new insights for practitioners and revealing intriguing failure cases. |
Backpropagating through Structured Argmax using a SPIGOT (P18-1)
Copied to clipboard
| Challenge: | Structured projection of intermediate gradients (SPIGOT) is a new method for backpropagating through neural networks . structure-based learning methods for natural language processing are increasingly dominated by end-to-end differentiable functions . |
| Approach: | They propose a structured projection of intermediate gradients method for backpropagating through neural networks that includes hard-decision structured predictions in intermediate layers. |
| Outcome: | The proposed method improves on two structured NLP pipelines: syntactic-then-semantic dependency parsing and semantic parser followed by sentiment classification. |
End-to-End Learnable Psychiatric Scale Guided Risky Post Screening for Depression Detection on Social Media (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to detect depression from social media posting history are limited by frozen screening models and lack of learning. |
| Approach: | They propose to use a frozen screening model to train a risky post detection model with psychiatric scales to enable a learnable end-to-end learning process. |
| Outcome: | The proposed model outperforms several strong baseline methods and qualitative analysis confirms that it better captures users’ mental states than others. |